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Objective 


To build a system that can identify rooms from 
point-clouds of indoor environments obtained by 
smart hand-held device like Google's Tango. 





Indoor structure 
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2 Motivation 


□ 

□ 

□ 


GPS signal not enough for indoor navigation 

Scarcity of indoor floor plan 

Such application can help nagivation in vast 

constructions 


State of The Art 


□ 


□ 


□ 


Google Tango Floorplanner Application [1] 
produces rough indoor model given a 
pointcloud 

Hasnath et al. [2] can answer navigation query 
given room and passway position 
However, extracting rooms from rough indoor 
model is still a challenging problem. 




Hasnath et al. 
AutoCadroid 

- ► 



Room Positions 


Indoor Navigation 


4 Problem Overview 


□ Tango application produces rough indoor model 

□ We consider only wall polygons 

□ We fragment wall polygons into points 

□ This point set is our input 





Actual layout 


Rough model from 
Tango's application 


Fragmented into 
points 
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5 Problem Definition 


Given a set of points P = {Pi,P 2 * —>Pn}> find a set 
of rooms, R = { R lt R 2 , ..., Rr}. Each room R t G R is 
a polygon with a sequence of points as vertices. As 
per our restriction, each room R t has 4 corners, so 

fit = {Oil. Tii). Ok. Tk). (xa,ya),(x i 4 ,y i4 )} 
Here, we consider only rectangular rooms. 


6 PtrNet Based Approach 


□ 


□ 


Pointer Network (PtrNet) is an encoder- 
decoder RNN architecture 
PtrNet can learn to solve problems where 
output objects are selected from input objects, 
e.g. Convex Hull, Delaunay Triangulation, TSP 
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(b) Ptr-Net 


□ We tasked PtrNet to select only corner points 
from a given sequence of points 
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Sample Scenario (15 points) 


PtrNet Encoder Decoder (selecting corners) 


□ Depending on input point order, we introduced 
3 PtrNet variants: 

1. PtrNet-TrueSort: Sorted anticlockwise, Not 
realistic as device output is not ordered 

2. PtrNet-Random: Random order, Realistic 

3. PtrNet-PseudoSort: Randomized first to make 
realistic, then sorted based on proximity to the 
last seletected point 


7 Mask-RCNN Based Approach 


□ Mask-RCNN can learn to segment objects from 
image in pixel level 

□ Input is image, output is separate binary masks 
for each object 

□ We plotted point set onto an image 

□ We trained Mask-RCNN to produce binary 
masks for individual rooms 
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8 Experiments 


□ We used synthetic dataset 

□ We used Intersection-over-Union (loU) score as 
performance metric 


IoU = 


Area of Intersection 


Area of Union 




□ 


□ 


Firstly, a synthetic dataset with 160 maximum 
number of points, and 15cm maximum 
deviation 

An overall IoU score is measured 


IoU Score 


MaskRCNN 


PtrNet-PseudoSort 


PtrNet-Random 


PtrNet-TrueSort 


0.92 


0.87 


0.98 


0.8 


0.85 

IoU Score 


0.9 


0.95 


□ Then, maxium number of points is varied 


Models 

Max. Input Length 

100 

200 

300 

Mask-RCNN 

0.853 

0.899 

0.904 

PtrNet-PseudoSort 

0.909 

0.917 

0.916 

PtrNet-Random 

0.833 

0.834 

0.823 

PtrNet-TrueSort 

0.981 

0.984 

0.986 


□ Then, maxium point deviation is varied 

□ It is how much a point is deviated from its 
original position 

□ This is to simulate noisy indoor environment 


Models 

Max. Point Deviation 

5cm 

15cm 

25cm 

Mask-RCNN 

0.914 

0.899 

0.852 

PtrNet-PseudoSort 

0.961 

0.917 

0.899 

PtrNet-Random 

0.840 

0.834 

0.801 

PtrNet-TrueSort 

0.99 

0.984 

0.980 


9 Conclusion 


□ This kind of problems can be learned 

□ Input order has signicant effect over PtrNet 
models 

□ Perfecting input order will give rise to 
performance 

□ PtrNet struggles in long sequence, MaskRCNN 
does not 

□ All models struggle in noisy environment, so 
noise reduction too can improve performance 
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